Large Deviations Theory and Empirical Estimator Choice
نویسندگان
چکیده
Criterion choice is such a hard problem in information recovery and in estimation and inference. In the case of inverse problems with noise, can probabilistic laws provide a basis for empirical estimator choice? That is the problem we investigate in this paper. Large Deviations Theory is used to evaluate the choice of estimator in the case of two fundamental situations-problems in modelling data. The probabilistic laws developed demonstrate that each problem has a unique solution-empirical estimator. Whether other members of the empirical estimator family can be associated a particular problem and conditional limit theorem, is an open question. Large Deviations Theory and Empirical Estimator Choice∗ Marian Grendar† George Judge‡
منابع مشابه
Delta Method in Large Deviations and Moderate Deviations for Estimators by Fuqing
The delta method is a popular and elementary tool for deriving limiting distributions of transformed statistics, while applications of asymptotic distributions do not allow one to obtain desirable accuracy of approximation for tail probabilities. The large and moderate deviation theory can achieve this goal. Motivated by the delta method in weak convergence, a general delta method in large devi...
متن کاملPreliminary Draft MINIMAX ESTIMATION AND TESTING FOR MOMENT CONDITION MODELS VIA LARGE DEVIATIONS
This paper studies asymptotically optimal estimation and testing procedures for moment condition models using the theory of large deviations (LD). Minimax risk estimation and testing are discussed in details. The aim of the paper is three-fold. First, it studies a moment condition model by treating it as a statistical experiment in Le Cam’s sense, and investigates its large deviation properties...
متن کاملHigh confidence estimates of the mean of heavy-tailed real random variables
We present new estimators of the mean of a real valued random variable, based on PAC-Bayesian iterative truncation. We analyze the non-asymptotic minimax properties of the deviations of estimators for distributions having either a bounded variance or a bounded kurtosis. It turns out that these minimax deviations are of the same order as the deviations of the empirical mean estimator of a Gaussi...
متن کاملLarge and Moderate Deviation Principles for Kernel Distribution Estimator
In this paper we prove large and moderate deviations principles for the kernel estimator of a distribution function introduced by Nadaraya [1964. Some new estimates for distribution functions. Theory Probab. Appl. 9, 497500]. We provide results both for the pointwise and the uniform deviations. Mathematics Subject Classifiation: 62E20, 60F10
متن کاملA Large Deviations Analysis of Quantile Estimation with Application to Value At Risk
Quantile estimation has become increasingly important, particularly in the nancial industry, where Value-at-Risk has emerged as a standard measurement tool for controlling portfolio risk. In this paper we apply the theory of large deviations to analyze various simulation-based quantile estimators. First, we show that the coverage probability of the standard quantile estimator converges to one e...
متن کامل